Promoting proactive replicability in computer-based communication science by shifting the effort upstream and automating processes

This project develops and tests protocols and digital tools to enhance replicability in Computational Communication Science. The goal is to support researchers early in the publication process to foster more transparent and robust research practices.

The project is supported by the German Research Foundation (DFG).

Description of the project

This project aims to develop, implement, and systematically evaluate solutions to improve replicability and reproducibility in Computational Communication Science (CCS). The need for such solutions has been highlighted by meta-scientific studies, including the first funding phase of the META-REP program (→ see the project: "What defines and influences replicability in Computational Communication Science?" [Please link to the project "What defines and influences replicability in Computational Communication Science?"]). Earlier studies, including our own research, emphasize the central role of the publication and review process in achieving replicability.
Building on these insights, the project, in the second funding phase of the META-REP program, aims to develop replication and reproduction protocols that proactively promote replicability. These protocols are designed to encourage researchers during the publication process to structure their studies in ways that enhance replicability and reproducibility. To this end, we will create specific protocols for CCS and design digital tools that use data mining and modern language models (LLMs) to automatically extract relevant information from manuscripts.
The protocols and tools will be tested in collaboration with the journal Computational Communication Research and the “Computational Methods” Division of the International Communication Association in two experimental studies to evaluate their effectiveness. The project’s results will be compiled into guidelines and training materials, offering researchers concrete support for improving replicability and reproducibility. The goal is to anchor these findings sustainably in the scientific practices of CCS and thereby contribute to a more transparent and robust research culture.
This project represents the second phase of the RepCCS project.
Link to the website of the META-REP priority program: https://www.meta-rep.uni-muenchen.de/index.html

Keywords

Open Science | AI-supported tools | Computational Communication Science

Leader of the Research Project

Prof. Dr. Mario Haim

Professor

Computational Communication Science • Political Communication • Computational Journalism

Meet the team

The research project is based at the IfKW at LMU. A total of one employee is working on it.

Philipp Knöpfle, M.Sc.

Academic Staff

Open Science • Meta Science • Computational Methods • AI & LLMs

External partners